Computer-Assisted Lip Reading Recognition for Hearing Impaired
نویسندگان
چکیده
Within the communication process of human beings, the speaker’s facial expression and lip-shape movement contains extremely rich language information. The hearing impaired, aside from using residual listening to communicate with other people, can also use lip reading as a communication tool. As the hearing impaired learn the lip reading using a computer-assisted lip-reading system, they can freely learn lip reading without the constraints of time, place or situation. Therefore, we propose a computer-assisted lip-reading system (CALRS) for phonetic pronunciation recognition of the correct lip-shape with an image processing method, object-oriented language and neuro-network. This system can accurately compare the lip image of Mandarin phonetic pronunciation using self-organizing map neuro-network (SOMNN) and extension theory to help hearing impaired correct their pronunciation. 2007 Published by Elsevier Ltd.
منابع مشابه
Designing and implementing a system for Automatic recognition of Persian letters by Lip-reading using image processing methods
For many years, speech has been the most natural and efficient means of information exchange for human beings. With the advancement of technology and the prevalence of computer usage, the design and production of speech recognition systems have been considered by researchers. Among this, lip-reading techniques encountered with many challenges for speech recognition, that one of the challenges b...
متن کامللبخوانی و ادراک گفتار دانشآموزان کمشنوای مدارس ویژۀ کمشنوایان در شهر تهران
Objective: The goal of this study was to evaluate the lip reading ability and Speech perception of hearing impaired students of special schools for the hearing impaired in different speech levels. Materials & Methods: In this cross- sectional study, 44 deaf students (9-12 years old) were selected with multi-stage cluster sampling method, from two special schools for the deaf in Tehran. Tools...
متن کاملSpeaker - Independent Visual Lip Activity Detection for Human - Computer Interaction
Recently there is an increased interest in using the visual features for improved speech processing. Lip reading plays a vital role in visual speech processing. In this paper, a new approach for lip reading is presented. Visual speech recognition is applied in mobile phone applications, human-computer interaction and also to recognize the spoken words of hearing impaired persons. The visual spe...
متن کاملLip reading role in the hearing aid fitting process.
UNLABELLED Lip reading (LR) is unconsciously practiced as we communicate and has currently been widely used in the assessment of hearing impaired people. The hearing challenged individual is able "to read" lip position and thus interpret the speech sounds of the speaker; however, it is very likely that the best lip reader can only catch 50% of the words uttered. METHODOLOGY 30 individuals of ...
متن کامل10 Gestural Interfaces for Hearing-Impaired Communication
Recent research in Human-Computer Interaction (HCI) has focused on equipping machines with means of communication that are used between humans, such as speech and accompanying gestures. For the hearing impaired , the visual components of speech, such as lip movements, or ges-tural languages such as sign language are available means of communication. This has led researchers to focus on lip read...
متن کامل